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Abstract 

Background: The Swedish Salmonella control program has been running for decades and has resulted in a low 
prevalence of Salmonella in Swedish food producing animals. Routine bacteriology is used to detect Salmonella, 
however, bacteriology is time consuming, costly and has a low sensitivity. Different enzyme-linked immunosorbent 
assays (ELISAs) have been developed for detection of antibodies against Salmonella Dublin and S. Typhimurium in 
bovine bulk milk, individual milk samples as well as in sera. Screening bulk milk for antibodies against Salmonella 
spp. could improve the cost-effectiveness of the surveillance in Swedish dairy cattle, but as characteristics of tests 
may vary in different populations, tests should always be evaluated in the specific population where they will be 
used. Hence, the aim of this study was to evaluate the specificities of three bovine ELISAs when used to analyse 
bulk milk samples from Swedish dairy cattle. A second aim was to compare the performance of the two Dublin 
ELISAs tested. 

Methods: Bulk milk samples for analysis were randomly selected from samples collected within the Swedish bulk 
milk sampling scheme and analyzed with the three ELISAs; a Danish in-house Dublin ELISA, PrioCHECK® Salmonella 
Ab bovine Dublin ELISA and PrioCHECK® Salmonella Ab bovine ELISA (hereafter named mixed ELISA). The 
specificities of the ELISAs were calculated assuming a disease-free status in Sweden i.e. that all test positive samples 
were assumed to be false positive results. This assumption can be used when a disease is known to be infrequent. 

Results: The calculated specificities of the two Dublin ELISAs and the mixed ELISA, when using the producer's 
recommended cut-off value of the corrected optic-density percent (ODC%) were 99.4% (95% Confidence Interval 
(CI): 98.8% -99.8%), 99.4% (95% CI: 98.8% -99.8%) and 97.9% (95% CI: 96.8% -98.7%), respectively. The correlation 
between the ODC% values of the two Dublin ELISAs was 0.83. 

Conclusions: We conclude that the evaluated ELISAs have sufficiently high specificities to be used as supplement 
to bacteriological examinations in the Swedish Salmonella control program in cattle as well as a primary screening 
test in routine surveillance for S. Dublin. 
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Background 

The Swedish Salmonella control program has been run- 
ning since 1961 and has resulted in a very low preva- 
lence of Salmonella infection in Swedish food producing 
animals [1,2]. All serotypes of Salmonella are encom- 
passed by the program. 

The surveillance program of Swedish cattle herds is 
based on required sampling of clinical suspicions of sal- 
monellosis, routine sampling of calves submitted for 
post mortem examination and sampling of lymph nodes 
at slaughterhouses [2]. Whenever Salmonella is detected 
in a herd, the herd is put under restrictions and an 
eradication program is performed until two consecutive 
fecal samplings representing all individuals within the 
herd are culture negative. Closing down the sanitary 
slaughter during the late nineties, where animals with 
clinical disease were culled and sampled for Salmonella, 
resulted in reduced sensitivity of the surveillance for Sal- 
monella in Swedish cattle [3]. This raised a need for new 
and cost-effective tools for surveillance and control of 
Salmonella in Swedish cattle. 

As the consequences of a positive Salmonella test are 
extensive in Sweden, both for farmers as well as for the 
authorities, false positive results are undesirable. This 
has been avoided by use of bacteriological culture as the 
only analytical method within the program, as the speci- 
ficity of culture is considered to be close to 100%. How- 
ever, as the sensitivity of fecal culture at the individual 
level is low, all animals in the herd need to be sampled 
to obtain a herd level diagnosis. Sampling of all animals 
in a herd is costly and time consuming. Enzyme-linked 
immunosorbent assays (ELISAs) have been developed 
for detection of antibodies against Salmonella Dublin 
and S. Typhimurium in sera, individual milk samples 
and bulk milk [4-7]. Single bulk milk samples have been 
shown to have low sensitivity for detecting Salmonella 
infected herds but combinations of samples such as bulk 
milk and serum samples from calves or repeated bulk 
milk samples have been reported to achieve high sensi- 
tivity at herd level [8-10]. The specificity of bulk milk 
samples has been evaluated in several studies and has 
been shown to range from 0.95 to 1.00 depending on, 
among other things, underlying herd level prevalence 
[6,9]. As test performance may vary in different popula- 
tions it is important to evaluate new serological tests in 
the current population before considering use within a 
control program. 

The aim of this study was to evaluate the specificities 
of three ELISA tests in the Swedish dairy cattle popula- 
tion; a Danish in-house Dublin ELISA (hereafter named 
Danish Dublin ELISA) and two ELISA kits developed by 
Prionics AG, Switzerland (PrioCHECK® Salmonella Ab 
bovine Dublin ELISA, hereafter named Prionics Dublin 
ELISA and PrioCHECK® Salmonella Ab bovine ELISA, 



hereafter named Prionics mixed ELISA). Both the ELI- 
SAs developed by Prionics originate from the Danish 
National Veterinary Institute. A second aim was to com- 
pare the performance of Prionics Dublin ELISA with the 
Danish Dublin ELISA. 

The present study was a part of Prionics AGs field 
evaluation of the Prionics Dublin and mixed ELISAs. 
These tests are now, after minor adjustments, sold by 
Prionics AG, and are presently the only commercial kits 
on the market for detection of Salmonella antibodies 
in cattle. 

Methods 

The sample size for estimating the specificity of the 
diagnostic tests was calculated using the exact binomial 
method (as the specificity was expected to be close to 1): 

^ W ^P*(1 — P)"~ x ; where P is the hypothesized propor- 
tion, n is the sample size, and x is the number of 
observed "successes" [11]. The tests specificities was 
assumed to be 99% (P=0.99), to have a precision of ±1%, 
and the estimated specificity should be within these lim- 
its with a 99% confidence interval. This required a sam- 
ple size of 974. 

The samples for analyses were selected from samples 
collected within the national bulk milk sampling scheme 
including samples from all Swedish dairy herds (approxi- 
mate 7100 herds in 2007 [12]). The sampling was per- 
formed in the autumn of 2007. Samples from herds under 
restrictions were omitted as they were assumed to be 
infected. The first milk sample was randomly collected 
from the six first received milk samples of the national 
bulk milk sampling and thereafter every sixth milk sample 
was selected, to reach the calculated sample size. If suffi- 
cient material was not available in the selected milk sam- 
ple, the next sample was collected. In total, bulk milk 
samples from 1069 different herds were collected. 

The samples were stored at -20°C in duplicates, and 
additionally, one sample was sent to the National Veter- 
inary Institute DTU in Denmark for analysis using the 
Danish Dublin ELISA. The remaining samples were used 
for analysis with Prionics Dublin and Mixed ELISAs. 
The Danish Dublin ELISA, including O antigen 0:1, 
9 and 12, mainly detects antibodies against 5. Dublin. 
This test was performed according to the methods of 
Hoorfar et al. [5,6] and a cut-off value of corrected 
optic-density percent (ODC%) > 55 was used. The du- 
plicate samples were analyzed at the National Veteri- 
nary Institute in Sweden using Prionics mixed ELISA 
(including O-antigens 1, 9 and 12 and 1, 4, 5 and 12, 
mainly detecting S. Dublin and S. Typhimurium) and 
Prionics Dublin ELISA (including O-antigens 1, 9 and 
12, mainly detecting S. Dublin). The analyses were 
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performed according to the instructions from the manufac- 
turer (Prionics AG, Switzerland); test samples were placed 
in the wells of the test plates and incubated at room 
temperature (22±3°C). Subsequently, the plates were 
washed and the horseradish peroxidase conjugate was 
added and then the plates were incubated for 60±5 min at 
room temperature (22±3°C). Thereafter the plates were 
washed and the ready-to-use chromogen (tetramethylben- 
zidine) substrate was dispensed to all wells of the test 
plate. After incubation for 15 min at 22±3°C the colour 
development was stopped (using a ready-to-use stop so- 
lution) and measured at 450 nm. According to the pro- 
ducer's recommendations a sample is considered positive 
if the ODC% (as termed percent positivity, PP-value by 
the producer) is > 35. 

Statistics 

Descriptive statistics of the ODC% were performed using 
distributional graphs and scatter plots. Moreover, the geo- 
graphic representativeness of the collected samples was 
investigated, comparing the number of collected samples 
from different geographic areas (at that time Sweden had 
8 different regional dairy livestock organizations) with the 
total number of dairy herds within those areas. 

The specificities of the three ELISAs were calculated 
assuming a disease-free status in Sweden i.e. that all test 
positive samples were assumed to be false positive 
results. This assumption can be used when a disease is 
known to be infrequent [13]. 

Confidence intervals (CI) of the estimates of the speci- 
ficity were calculated and graphs showing how the speci- 
ficities changes with different ODC% cut-offs values 
were made in Stata Statistical Software (Release 11.2; 
College Station, TX, USA: StataCorp LP). The correl- 
ation coefficient between the ODC% values of the Da- 
nish Dublin ELISA and the Prionics Dublin ELISA, and 
between the Prionics ELISAs were calculated using Stata 
Statistical Software. Moreover, the expected number of 
test-positive herds was calculated, if any of the ELISAs 
should be used in the present Swedish dairy herd popu- 
lation (2011; [14]), at the producers recommended cut- 
off value of ODC% 35 and ODC% 55, respectively, and 
for comparison with a lower cut-off, ODC% 20 and 
25, respectively. 



Results 

Due to small amounts of milk in some of the 1069 sam- 
ple tubes all samples could not be analysed with all ELI- 
SAs. The number of analysed samples with each test is 
presented in Table 1. The results of the geographic rep- 
resentativeness showed that 14-20% (mean=17%) of the 
herds in each region were sampled. 

The distributions of ODC% value for all three ELISAs 
are shown in the histograms in Figure 1. The calculated 
specificities of the ELISAs for different ODC% cut-off 
values are shown in the graphs in Figure 2. The calcu- 
lated specificities and 95% CI when using the producer's 
recommended cut-off values are shown in Table 1. 
Expected numbers of test-positive herds at the cut-off 
values of 20, 25, 35 and 55, respectively are presented 
in Table 2. 

The correlation between the ODC% values of the two 
Dublin ELISAs, and of the two Prionics ELISAs, was 
0.83 and 0.56, respectively. Scatter plots of the ODC% 
values for the two Dublin ELISAs are shown in Figure 3, 
as well as a scatter plot of the ODC% values for the two 
Prionics ELISAs. 

Discussion 

The specificities of the evaluated tests were high when 
using the ODC% cut-off value recommended by the pro- 
ducer. The specificity curves (Figure 2) show that the cut- 
off value can be decreased with the specificity remaining 
high for the Dublin ELISAs. For the mixed ELISA the cal- 
culated specificity was slightly less than for the Dublin 
ELISAs and it decreased faster when lowering the cut-off 
value. Our results are in agreement with Veling et al. [9] 
where the specificity of a Dublin lipopolysaccharide ELISA 
was 100% using bulk milk from 200 Swedish dairy herds. 

The calculations used in the present study are based 
on the assumption that all positive results were false 
positives, i.e. an assumption that the samples originate 
from a disease-free population. Despite the extensive 
sampling within the present Swedish control program, 
on average only nine cattle herds per year (approxi- 
mately 0.2%) have been detected positive for Salmonella 
during the last five years. Hence, we think it is reason- 
able to assume that the Swedish dairy population has a 
low prevalence of Salmonella and the assumption for 



Table 1 Specificities of three different ELISAs detecting antibodies against Salmonella when used in Swedish dairy 
cattle using the ODC% value recommended by the producer as cut-off value 

Test No. of samples Specificity (95% CI 1 ) 

Danish Dublin in-house ELISA (cut-off at ODC% 55) 1 067 99.4% (98.8% -99.8%) 

Prionics Dublin ELISA 2 (cut-off at ODC% 35) 1 065 99.4% (98.8% -99.8%) 

Prionics mixed ELISA 3 (cut-off at ODC% 35) 988 97.9% (96.8% -98.7%) 
1 CI: confidence interval. 

2 PrioCHECK® Salmonella Ab bovine Dublin ELISA. 
3 PrioCHECK® Salmonella Ab bovine ELISA. 
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Figure 1 Distribution of the corrected optic-density percent of three different ELISAs detecting antibodies against Salmonella. 

Distributional graphs of the corrected optic-density percent (ODC%) of three different serological analyses of randomly selected bulk milk samples 
from Swedish dairy herds (2007). A: Prionics Dublin ELISA (PrioCHECK® Salmonella Ab bovine Dublin ELISA), n=1065; B: a Danish in-house Dublin 
ELISA, n=1067; C: Prionics mixed ELISA (PrioCHECK® Salmonella Ab bovine ELISA), n=988. The red line represents the producers recommended 
cut-off for these ELISAs. 
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Figure 2 The specificity at different cut-off values of three different ELISAs detecting antibodies against Salmonella. The specificity and 
95% confidence interval at different cut-off values of three different ELISAs detecting antibodies against Salmonella. A: Prionics Dublin ELISA 
(PrioCHECK® Salmonella Ab bovine Dublin ELISA), n=1065; B: a Danish in-house Dublin ELISA, n=1067; C: Prionics mixed ELISA (PrioCHECK® 
Salmonella Ab bovine ELISA), n=988. The red line represents the producer's recommended cut-off value for these ELISAs. 
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Table 2 Expected number of test positive Swedish dairy herds in 2011 (n=5200 [14]) at different 0DC% for three 
ELISAs detecting antibodies against Salmonella 

ELISA used Expected number of test positive herds 

at 0DC% recommended by the producer 1 at ODC% 20 or 25 2 

29 (95% CI 3 : 10-63) 58 (95% CI: 30-101) 

29 (95% CI: 1 1-63) 63 (95% CI: 33-107) 

1 05 (95% CI: 69-1 68) 1 90 (95% CI: 1 38-266) 

1 ODC% 35 for Prionics ELISAs and ODC% 55 for the Danish in-house ELISA. 
2 ODC% 20 for Prionics ELISAs and ODC% 25 for the Danish in-house ELISA. 
3 CI: confidence interval. 

"PrioCHECK® Salmonella Ab bovine Dublin ELISA. 
5 PrioCHECK® Salmonella Ab bovine ELISA. 



Danish in-house Dublin ELISA 
Prionics Dublin ELISA 4 
Prionics mixed ELISA 5 



the calculations of the tests specificities used in the 
present study is valid. This assumption was also used by 
Veling et al. [9] in the above mentioned study, where he 
used bulk milk from Swedish dairy herds from the 
northern part of Sweden, a region where Salmonella 
infected herds only very seldom are detected. However, 
as Salmonella infection does occur at a low prevalence 



we can expect that some of the positive samples are true 
positives. This is supported by the fact that the geo- 
graphical distribution of S. Dublin positive cattle herds 
in Sweden is known to be uneven with a cluster in the 
south east of Sweden [15] which coincided with the geo- 
graphical distribution of S. Dublin test positive samples 
in this study. 




0 20 40 60 80 100 0 20 40 60 80 100 
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Figure 3 Scatter plots comparing the results of three different ELISAs detecting antibodies against Salmonella. Comparing results of 
serological analyses of bulk milk samples analyzed using Prionics Dublin ELISA (PrioCHECK® Salmonella Ab bovine Dublin ELISA) and a Danish 
in-house Dublin ELISA (n=1063), or Prionics Dublin ELISA and Prionics mixed ELISA (PrioCHECK® Salmonella Ab bovine ELISA) (n=984). The red 
line represents the producer's recommended cut-off value for these ELISAs. 
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A larger number of herds tested positive with Prionics 
mixed ELISA than with the Dublin ELISAs. This could 
be explained by an expected larger number of true posi- 
tive herds being detected with the mixed ELISA, rather 
than a lower specificity of this test. Other serotypes than 
S. Dublin are isolated from about half of the Swedish 
cattle herds detected with Salmonella, which is in line 
with the results of this study where the number of test 
positive herds with Prionics mixed ELISA were about 
twice as many as with the Dublin ELISAs. 

Given that some of the positive samples in this study 
are true positive, the specificity estimates are underesti- 
mated and the true specificities of these tests are prob- 
ably even higher than was shown in our study. Although 
the specificities of the ELISAs are high in the general 
Swedish dairy population, the specificities may decrease 
when used in subpopulations with a higher prevalence 
of Salmonella as antibodies persist after a Salmonella in- 
fection has been cleared from a herd [16]. In Sweden, 
there will be interventions in all test-positive herds and 
therefore it is important to evaluate the specificity of a 
Salmonella test before using it more extensively. It is 
also of great value for the authorities to be able to esti- 
mate the expected number of test-positive herds, in 
order to estimate workload and costs following for ex- 
ample a national bulk milk screening. Serial testing of 
herds, with an initial bulk-milk screening with follow up 
examination of positive herds with individual serology 
and/or bacteriology before restrictions are put on a herd, 
could be a cost-effective alternative. This would result in 
an increased number of detected herds compared to the 
number detected in the present control program. The 
expected number of test-positive herds in Sweden at 
present was calculated based on the results of this study 
at different cut-off values. Decreasing the cut-off value 
from ODC% 35 or 55 to 20 and 25, respectively, would 
roughly double the number of test-positive herds. How- 
ever, decreasing the cut-off value will increase the sensi- 
tivity which is desirable. As the true Salmonella status of 
the sampled herds was not known in the present study 
the sensitivity of the ELISAs was not evaluated. 

The correlation between the Danish Dublin ELISA and 
Prionics Dublin ELISA was high, which was expected as 
Prionics ELISA has been developed from the Danish 
ELISA. Moreover, the comparison between the Prionics 
Dublin ELISA and mixed ELISA shows the usefulness of 
using both ELISAs'. If the aim of an investigation is to 
screen for Salmonella in more general terms the mixed 
ELISA should be used, and the Dublin ELISA can be used 
in a serial testing to distinguish S. Dublin herds. 

The tests used in this study are primarily designed for 
detecting S. Dublin and 5. Typhimurium. However, other 
Salmonella serotypes can cross-react, especially in the 
mixed ELISA [6,17]. In Sweden, the majority of herds 



detected with Salmonella are infected with S. Dublin or S. 
Typhimurium, and only a small proportion of cattle herds 
have been detected with other serotypes. From the Swed- 
ish point of view it is an advantage if antibodies against 
the vast majority of Salmonella serotypes occurring in cat- 
tle herds can be expected to be detected by the mixed 
ELISA. However, the Swedish control program encom- 
passes all serotypes of Salmonella, and therefore serology 
can be a very good complement to, but never completely 
substitute, bacteriology in Salmonella surveillance. 

Conclusions 

We conclude that the evaluated ELISAs have sufficiendy 
high specificities to be used as supplement to bacteriological 
examinations in the Swedish Salmonella control program in 
catde as well as a primary screening test in routine surveil- 
lance for S. Dublin. 
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